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Description 

PRE-CRASH SENSING SYSTEM AND 
METHOD FOR DETECTING AND 
CLASSIFYING OBJECTS 

Background of Invention 

[0001] The present invention relates generally to pre-crash sens- 
ing systems for vehicles, and more particularly to a pre- 
crash sensing system and method for processing images 
within a substantially quick period of time. 

[0002] Vehicle safety systems typically include pre-crash sensing 
("PCS") systems and countermeasure systems, which are 
actuated by the PCS systems. 

[0003] The PCS systems ordinarily utilize one or more sensors for 
detecting and/or measuring objects located external to 
the vehicle. Specifically, typical PCS systems utilize the 
sensors to indiscriminately and simultaneously detect ev- 
ery object within the sensor's field of detection during 
each sensing cycle. These sensors typically are coupled to 
a controller or microprocessor for sending various kinds 



of input data to the controller. This controller usually pro- 
cesses the input data for identifying the objects and clas- 
sifying these objects into predetermined categories. 

[0004] In so doing, the controller can utilize an intricate algo- 
rithm or process for analyzing the input data. This algo- 
rithm requires a predetermined amount of computational 
power and speed from the controller. It is understood that 
the presence and detection of multiple objects can in- 
crease the amount of power and speed required from the 
controller in order for the PCS system to operate properly. 

[0005] It would be desirable to provide a PCS system and method 

for identifying and classifying objects with even greater 

speed and efficiency than existing PCS systems. 
Summary of Invention 

[0006] One embodiment of the present invention is a pre-crash 
sensing system for a vehicle, which processes images 
within a substantially quick time. This system includes 
one or more sensors for detecting one or more objects 
that are located external to the vehicle. These sensors are 
coupled to a controller for transmitting data associated 
with an object to the controller. The controller utilizes an 
algorithm to store this data and the object's identity when 
the controller determines that the object was not previ- 



ously detected and/or identified by tlie system. Also, the 
controller utilizes the algorithm to classify the object into 
a predetermined category when the controller determines 
that the object requires classification. 
[0007] One advantage of the present invention is that a pre-crash 
sensing system is provided that selectively identifies and/ 
or classifies detected objects on an as-needed basis so as 
to decrease computational requirements of the system's 
controller and to enhance overall performance of the sys- 
tem. 

[0008] Another advantage of the present invention is that a 

method for processing images is provided that can utilize 
substantially low-powered microprocessors and thus de- 
crease the costs of the systems. 

[0009] Yet another advantage of the present invention is that a 
pre-crash sensing system is provided that can utilize two 
or more low-cost, specialized sensors for taking substan- 
tially accurate measurements. 

[0010] Other advantages of the present invention will become 

apparent upon considering the following detailed descrip- 
tion and appended claims, and upon reference to the ac- 
companying drawings. 
Brief Description of Drawings 



[0011] For a more complete understanding of this invention, ref- 
erence should now be made to the embodiments illus- 
trated in greater detail in the accompanying drawings and 
described below byway of the examples of the invention: 

[0012] FIGURE 1 is a schematic diagram of a vehicle safety sys- 
tem including a pre-crash sensing system, according to 
one advantageous embodiment of the claimed invention; 
and 

[0013] FIGURE 2 is a logic flow diagram of a method for operat- 
ing the pre-crash sensing system shown in FIGURE 1, ac- 
cording to one advantageous embodiment of the claimed 

invention. 
Detailed Description 

[0014] In the following figures, the same reference numerals are 
used to identify the same components in the various 
views. 

[0015] The present invention is particularly suited for a pre-crash 
sensing system integrated within a vehicle. In this regard, 
the embodiments described herein employ structural fea- 
tures where the context permits. However, it is under- 
stood that a variety of other embodiments without the de- 
scribed features are contemplated as well. Moreover, it is 
also contemplated that the method for operating the pre- 



crash sensing system can be utilized for various other 
suitable systems. For this reason, it follows that the in- 
vention can be carried out in a variety of other modes and 
utilized for other suitable applications as desired. 

[0016] Referring to Figure 1, there is shown a schematic diagram 
of vehicle safety system 10 ("VS system") having a pre- 
crash sensing system 12 ("PCS system"), according to one 
advantageous embodiment of the claimed invention. The 
PCS system 12 includes a series of sensors 14 for detect- 
ing one or more objects 16 located external to the vehicle 
18. For example, these sensors 14 can be positioned in 
forward-looking orientations for sensing objects in the 
vehicle's path. However, it will be appreciated that the 
sensors 14 can be positioned in other suitable orienta- 
tions as desired. It is also understood that the PCS system 
12 can instead utilize only one sensor while still providing 
efficient image processing by way of the algorithm de- 
tailed in the description for Figure 2. 

[0017] Referring back to Figure 1, the sensors 14 are utilized for 
detecting one or more parameters associated with each 
object 16. These parameters can include the object's 
height, width, depth, range, range rate, angle, various 
other suitable visual features or cues, or any combination 



thereof. The range of an object 16 is the distance between 
the object 16 and the vehicle 18. Similarly, the range rate 
is the change in distance between the object 16 and the 
vehicle during a unit change in time. Also, the angle is a 
measurement of the angular displacement of the object 
from a centerline 20 of the vehicle 18. 

[0018] In this embodiment, the sensors 14 are comprised of one 
or more visual-imaging cameras and one or more electro- 
magnetic wave-ranging devices. In this way, the visual- 
imaging cameras and the wave-ranging devices can be 
utilized in combination for detecting all the desired pa- 
rameters of each object. For instance, the visual-imaging 
cameras can be utilized for detecting each object's height, 
width, angle, and other visual features while the wave- 
ranging devices can be utilized for detecting the object's 
range, range rate, coarse width, and angle information. 

[0019] Specifically, the visual-imaging cameras preferably are 
monocular for accurately detecting each object's height, 
width, angle, and other visual feature information. A per- 
son of ordinary skill in the art will understand that the 
monocular cameras may not be as accurate as binocular 
cameras in measuring range and range rate. However, 
these monocular cameras can be substantially less expen- 



sive than the binocular cameras. Of course, it will be ap- 
preciated that binocular cameras can instead be utilized 
as desired. 

[0020] Further, as mentioned above, the wave-ranging devices 
are utilized for detecting the object's range, range rate, 
coarse width, and angle information. In this regard, the 
wave-ranging devices can accurately measure parameters, 
which are not easily and/or accurately detected by the vi- 
sual-imaging cameras. In one embodiment, these wave- 
ranging devices are radar devices. However, the wave- 
ranging devices can instead be lidar devices, stereo cam- 
era pair ranging devices, various other suitable wave- 
ranging devices, or any combination thereof as desired. 

[0021] As is known in the art, there exist certain wave-ranging 
devices that can accurately detect all of the aforemen- 
tioned parameters, including height and width, without 
the aid of visual-imaging cameras. However, similar to the 
binocular cameras, these wave-ranging devices can be 
substantially expensive. For this reason, the less sophisti- 
cated and more cost-beneficial wave-ranging devices can 
be utilized with the visual-imaging cameras to collectively 
provide all the desired parameters at lower costs than the 
higher technology wave-ranging devices. In addition, a 



person of ordinary skill in the art will understand that uti- 
lizing two or more different devices for detecting the 
same parameters can substantially improve the accuracy 
of the measurements. 

[0022] This "sensor fusion" feature is beneficial because it en- 
ables the PCS system 12 to utilize low-cost, specialized 
sensors 14 in combination for accurately detecting all the 
desired parameters of the objects 16. 

[0023] In further accordance with the invention, each sensor 14 is 
coupled to a controller 22. This controller 22 preferably is 
a microprocessor including a process-determining mod- 
ule 24, an object-tracking module 26, and an object- 
classifying module 28. The functions of each of these 
modules are exemplified in detail in the description for 
Figure 2. 

[0024] The controller 22 is coupled to one or more countermea- 
sure systems 30 in the vehicle 18. The countermeasure 
systems 30 can be active and/or passive as desired. The 
active countermeasure systems may include a brake con- 
trol system, a throttle control system, a steering control 
system, a suspension control system, a transmission con- 
trol system, various other chassis control systems, or any 
combination thereof. 



[0025] jhe passive countermeasure systems can include an in- 
ternal airbag control system, a pedestrian protection con- 
trol system, an external airbag control system, a seatbelt 
control system, a knee bolster control system, a head re- 
straint control system, a load-limiting pedal control sys- 
tem, a load-limiting steering control system, a preten- 
sioner control system, other suitable systems, or any 
combination thereof. The pretensioner control system 
may provide control over pyrotechnics and seatbelt pre- 
tensioners. Furthermore, the airbag control system may 
provide control over front airbags, side airbags, curtain 
airbags, hood airbags, various other airbags, or any com- 
bination thereof. Also, the pedestrian protection control 
system can include control over a deployable hood, a 
bumper system, various other protection devices, or any 
combination thereof. 

[0026] Referring now to Figure 2, there is shown a logic flow dia- 
gram of a method for operating the PCS system 12 shown 
in Figure 1, according to one advantageous embodiment 
of the claimed invention. The method begins in step 100 
and immediately proceeds to step 102. 

[0027] In step 102, one or more sensors 14 detect one or more 
desired parameters of each object 16 within the sensors" 



field of detection external to the vehicle 18. This step 
preferably is accomplished by utilizing a "sensor fusion" 
approach with a combination of one or more visual- 
imaging cameras and one or more electro-magnetic 
wave-ranging devices. Specifically, the cameras are uti- 
lized for detecting each object's height, width, angle, and 
other visual feature information while the wave-ranging 
devices are utilized for detecting the object's range, range 
rate, coarse width, and angle information. In this way, 
low-cost, specialized sensors 14 can be utilized in combi- 
nation for accurately detecting all the desired parameters 
of the objects 16. However, it is understood that various 
other suitable methods can be utilized for detecting the 
desired parameters of the objects 16. Then, the sequence 
proceeds to step 104. 
[0028] In step 104, the process-determining module 24 of the 
controller 22 receives input data, e.g. the measured pa- 
rameters of the objects 16, from the sensors 14. The pro- 
cess-determining module 24 generates a queue of de- 
tected objects with their respective measured parameters. 
Thereafter, the process-determining module 24 proceeds 
to step 106 for separately analyzing each object and its 
respective parameters. 



[0029] In step 106, the process-determining module 24 consid- 
ers the next detected object in the queue for the current 
cycle. At the beginning of a cycle, this object is the first 
object listed in the queue. In this step, the process- 
determining module 24 determines whether the detected 
object requires identification by the controller 22. 

[0030] specifically, the process-determining module 24 com- 
pares the measured parameters of the detected object and 
compares those parameters to a series of archived param- 
eters. These archived parameters and various other infor- 
mation are located within an object identification list that 
is stored in the object-tracking module 26. The archived 
parameters are associated with an object previously de- 
tected by the sensors. In this way, the process-deter- 
mining module can determine whether the detected object 
has been previously detected and identified by the con- 
troller 22. However, it will be appreciated that various 
other methods can be utilized for determining whether 
the detected object has been previously identified by the 
PCS system 12. If the process-determining module 24 de- 
termines that the detected object has not been previously 
detected and identified, then the sequence proceeds to 
step 108. 



[0031] In step 108, the process-determining module 24 actuates 
the object-traclcing module 26 to perform a subroutine 
for identifying the object 16 and updating the object 
identification list. Then the sequence proceeds to step 
110. 

[0032] However, if in step 106 the process-determining module 
24 determines that the detected object has been previ- 
ously detected and identified, then the process-de- 
termining module 24 immediately proceeds to step 110. 
In another embodiment, the process-determining module 
24 actuates the object-tracking module 26 to perform the 
subroutine for storing data related to the detected object, 
e.g. the measured parameters, regardless of whether the 
object has been previously detected and identified. 

[0033] In step 110, the process-determining module 24 deter- 
mines whether the object-classifying module 28 has pre- 
viously classified the object 16 into a predetermined cate- 
gory. Specifically, the process-determining module 24 
searches an object classification list, which is stored in the 
object-tracking module 26, for a classification associated 
with the detected object. If the process-determining mod- 
ule does not find a classification corresponding to the ob- 
ject, then the sequence proceeds to step 112. 



[0034] In step 112, the process-determining module 24 deter- 
mines tliat the object requires classification and actuates 
the object-classifying module 28 to perform a subroutine 
for classifying the detected object 16 into a predeter- 
mined category. For example, the object-classifying mod- 
ule 28 can classify the detected object as a "non-threat" 
when the range, range rate, and the angle measurements 
indicate that the object, e.g. a third-party vehicle, is in- 
creasing its distance from the vehicle 18 and is located 
substantially far from the centerline 20 path of the vehicle 
18. However, it is contemplated that the object-classifying 
module 28 can utilize the desired parameters for classify- 
ing the object into various other suitable categories as 
desired. Then, the sequence proceeds to step 116 de- 
scribed below. 

[0035] However, if in step 110 the process-determining module 
24 finds a classification associated with the detected ob- 
ject, then the sequence proceeds to step 114. 

[0036] In step 114, the process-determining module 24 and/or 
the object-classifying module 28 determines whether the 
classification associated with the object is outdated or 
otherwise inaccurate and thus requires updating. This 
step can be accomplished by comparing the current mea- 



sured parameters of the detected object with the previous 
classification and parameters associated with the object. 
For instance, the object's previous classification may indi- 
cate a "non-threat" situation, and its corresponding 
archived parameters can indicate that the object 16 was 
moving away from the vehicle 18. However, the current 
range, range rate, and angle measurements can indicate 
that the object has changed its direction toward the vehi- 
cle 18 at a substantially high speed. In that regard, the 
prior classification is outdated and requires the object- 
classifying module 28 to assign a new category to the ob- 
ject, e.g. "object requiring full-force airbag deployment." 
By that example or for any other reason that requires an 
updated classification, the sequence immediately pro- 
ceeds to step 112. 

[0037] However, if in step 114 the classification does not require 
updating, then the sequence proceeds to step 116. 

[0038] In step 116, the process-determining module determines 
whether other detected objects remain in the queue for 
analysis. If other detected objects are listed in the queue, 
then the sequence returns to step 106. 

[0039] However, if no objects remain in the queue, then the se- 
quence proceeds to step 118. In other words, a complete 



cycle of image processing can require that the entire 
queue of objects 16 is processed. 

[0040] Yet, in another embodiment, step 116 can be time re- 
stricted. Specifically, each cycle of image processing lasts 
for a predetermined amount of time regardless of whether 
any detected objects remain in the queue. In this regard, 
step 116 can be accomplished by requiring the process- 
determining module 24 to determine whether sufficient 
time remains in the cycle for processing the next object. 

[0041] In step 118, the object identification list and the object 

classification list are stored in the object-tracking module 
26. Then, the sequence proceeds to step 120. 

[0042] In step 120, the controller 20 sends the most recent ob- 
ject classification list to the countermeasure system 30. 

[0043] While particular embodiments of the invention have been 
shown and described, it will be understood, of course, 
that the invention is not limited thereto since modifica- 
tions may be made by those skilled in the art, particularly 
in light of the foregoing teachings. Accordingly, it is in- 
tended that the invention be limited only in terms of the 
appended claims. 



